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FOREWORD 


This  literature  review  was  performed  in  support  of  Navy  Decision  Coordinating 
Paper,  Manpower  Requirements  Development  System  (NDCP-Z0109-PN)  subproject 
Z0109-PN.03,  Manpower  Cost  in  System  Design,  and  under  the  sponsorship  of  the  Deputy 
Chief  of  Naval  Operations  (OP-01).  The  objective  of  this  subproject  is  to  reduce  the 
manpower  requirements  and  the  associated  life  cycle  costs  of  new  hardware  systems. 
Information  and  techniques  are  being  developed  to  assist  hardware  developers  in  assessing 
the  people-related  implications  of  their  designs  and  for  conducting  cost-effectiveness 
analyses  during  the  design  process. 

This  literature  review  was  the  first  step  in  developing  a  training-system  life  cycle 
cost  model  and  a  supporting  data  base.  The  purpose  of  the  training  system  cost  model  is 
to  identify  those  training  elements  having  significant  cost  implications  for  initial  and 
follow-on  hardware  system  training.  Through  the  use  of  such  a  model,  training  costs  can 
be  predicted  and  used  in  early  cost-effectiveness  studies  to  assess  more  accurately  the 
cost  implications  of  alternative  hardware  systems. 

This  literature  review  was  conducted  in  1978  and  subsequently  utilized  in  improv'ng 
the  Navy's  Enlisted  Billet  Cost  Model.  It  is  documented  at  this  time  to  make  it  available 
to  the  research  community. 

The  contracting  officer's  technical  representative  was  Mr.  John  F.  Brock. 

RICHARD  C.  SORENSON 
Director  of  Programs 
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SUMMARY 

Problem 

"-^Training  costs  have  been  an  increasing  contributor  to  the  life  cycle  costs  of  military 
weapon  systems.  As  the  concept  of  training  has  broadened  and  alternative  approaches  to 
training  have  become  available  through  the  development  of  new  technologies,  the 
difficulties  of  determining  and  projecting  training  costs  have  increased.. 

Purpose 

c~^The  purpose  of  this  effort  was  to  provide  background  and  materials  for  use  in  the 
construction  of  a  life  cycle  training  costs  model  for  determining  the  cost  of  training 
associated  with  the  life  cycle  of  Navy  weapon  systems. 

Approach  «.  . 

The  literature  selected  for  review  was  organized  into  three  subject  areas:  (1) 
system-oriented  life  cycle  training,  (2)  instructional  systems  development  (ISD),  and  (3) 
costing. 

Findings  and  Conclusions 

1.  Existing  models  of  major  system  acquisition  and  support  apparently  are  adequate 
for  establishing  general  training  requirements  and  training  development  plans. 

2.  Training  is  a  minor  cost  factor,  compared  to  other  elements  in  the  acquisition 
and  support  systems,  partly  because  the  training  spelled  out  in  these  models  is  the  factory 
training  that  takes  place  during  system  development  and  initial  deployment.  Any  follow- 
on  training  is  considered  to  be  simple  iteration  of  the  factory  course.  Training  efforts  up 
to  the  point  of  system  production  are,  in  fact,  insignificant  compared  to  the  hardware- 
oriented  efforts. 

3.  Actual  CNET  responsibilities  tend  to  develop  rather  late  in  the  system  acquisi¬ 
tion  cycle.  Even  in  the  training  plan  development,  they  have  only  a  supporting  role. 

4.  The  training  required  by  system  support  personnel  tends  to  be  ignored. 


5.  Increasingly  sophisticated  ISD  modeis  have  been  developed.  Instructional 
development  processes  have  been  defined  in  great  and  useful  detail.  The  current 
evolution  of  these  models,  however,  is  strong  in  the  middle  phases  of  the  process,  but 
weak  in  initial  training  requirements  and  system  planning  efforts.  These  models  are  also 
strong  in  the  areas  of  content  identification,  media  development,  and  student  handling. 
Conversely,  they  are  weak  in  the  areas  of  instruction,  equipment,  and  facility 
requirements,  as  well  as  in  instructional -system  evaluation,  revision,  administration,  and 
support. 

6.  Part  of  the  lack  of  emphasis  on  the  development  of  the  other  elements  may  stem 
from  the  fact  that  these  development  models  do  not  define  a  total  instructional  system. 

7.  If  ISD  is  to  become  what  the  name  implies,  instead  of  just  the  systematic 
development  of  instruction,  the  development  process  will  need  to  be  expanded  to 
encompass  the  entire  instructional  system. 

8.  Inadequate  attention  has  been  paid  to  the  costs  of  establishing  training  require¬ 
ments  and  plans  early  in  the  system  acquisition  process. 

9.  Most  efforts  have  addressed  only  the  initial  development  and  one-time  presenta¬ 
tion  of  instructional  material.  Course  repetition  costs  do  not  address  problems  of  revision 
or  redevelopment  of  instructional  materials  or  the  time  gaps  between  course  repetitions. 

10.  When  base  or  other  support  costs  are  presented,  there  is  very  little  detail. 

11.  At  this  time,  there  appears  to  be  more  disparity  than  uniformity  in  costing 
approaches,  levels  of  details  given,  categorization  of  systems  used,  and  cost  areas 
included. 

12.  The  diversity  in  approaches  found  in  the  literature  may  be  due  to  the  differing 
needs  of  the  individuals  involved  in  the  training  process:  The  initial  planners  in  the 
principal  development  agency,  the  training  development  specialists,  and  those  who 
manage  and  conduct  the  training  operations. 
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INTRODUCTION 


Problem 

Training  costs  have  been  an  increasing  contributor  to  the  life  cycle  costs  of  military 
weapon  systems.  As  the  concept  of  training  has  broadened  and  alternative  approaches  to 
training  have  become  available  through  the  development  of  new  technologies!  the 
difficulties  of  determining  and  projecting  training  costs  have  increased. 

Purpose 

This  literature  survey  is  the  first  step  in  the  development  of  a  model  to  describe  all 
of  the  training  required  to  develop,  man,  and  support  a  given  weapon  system  during  its  life 
cycle.  This  model  will  be  used  to  determine  all  the  training  costs  incurred  during  the 
lifetime  of  a  weapon  system. 

APPROACH 

The  literature  reviewed  came  from  a  number  of  sources  and  was  identified  principally 
by  four  major  literature  searches.  Prior  to  the  start  of  this  program,  a  Defense 
Documentation  Center  (DDC)  (now  Defense  Technical  Information  Center,  DTIC)  search 
was  made  using  key  words  in  the  area  of  training  costs.  This  was  supplemented  in  the 
early  part  of  the  program  by  a  second  DDC  search,  a  National  Aeronautics  and  Space 
Administration  literature  search,  and  a  dialog-on-line  retrieval  bibliography  search  using 
such  key  words  as  training  models,  instructional  systems  development  (ISD),  and  systems 
approach  to  training.  Nearly  100  potentially  appropriate  items  were  ordered  from  these 
lists  and,  except  for  a  few  limited  distribution  documents,  all  were  eventually  received. 
The  additional  documents  acquired  were  identified  from  surveys  of  the  literature 
acquired,  from  miscellaneous  contacts,  and  from  sequential  tracking  of  Department  of 
Defense  (DoD)  and  Navy  documents  and  instructions. 

The  literature  selected  for  review  was  organized  into  three  broad  overlapping  areas: 

1.  System-oriented  life  cycle  training,  including  information  about  the  kinds  and 
timing  of  instruction  during  system  acquisition  and  deployment,  the  integrated  logistic 
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support  (ICS)  development  process,  and  the  life  cycle  costing  approaches  that  have  been 
evolving  in  these  areas. 

2.  Instructional  systems  development,  including  the  nature  and  operation  of 
instructional  systems  and  the  ISD  process. 

3.  Costing,  including  general  costing  considerations,  costing  conventions  used  in  the 
system  acquisition  process,  and  ongoing  efforts  to  determine  training  costs. 


LITERATURE  REVIEW 
System-Oriented  Life  Cycie  T raining 

Weapon  System  Acquisition 

In  the  early  60s,  DoD  began  to  emphasize  the  support  characteristics  of  weapon- 
system  acquisitions.  Historical  records  had  revealed  that  the  acquisition  of  a  weapon 
system  involved  far  less  money  than  its  operation.  The  operational  support  character¬ 
istics  of  a  weapon  system,  which  include  such  elements  as  maintainability,  reliability, 
training,  and  technical  publications,  are  currently  classified  as  the  integrated  logistic 
Support  GLS)  concept.  The  ILS  literature  seldom  stresses  training  methods  or  cost  in 
system  design.  The  emphasis  appears  to  be  on  hardware  reliability.  As  an  example, 
Patterson  (1971)  discussed  training  as  an  ILS  category,  but  then  omitted  it  entirely  in  the 
costing  guidance  section. 

In  the  Naval  Air  Systems  Command  (NAVAIR)  system  acquisition  process,  the  only 
reference  to  training  is  in  regard  to  the  responsibility  of  naval  engineering  laboratories  to 
provide  technology  training,  on  a  consultant  basis,  to  the  system  project  office 
(Ottaviano,  1973).  Perschbacher  (1974),  in  another  Navy  study  on  life  cycle  costing 
(LCC),  was  concerned  only  with  the  funding  of  initial  training. 

In  an  Air  Force  study  of  the  aborted  procurement  of  the  SCAD  missile,  Kollin  (1966) 
described  the  early-stage  problems  of  a  training  special  project  office.  The  costly  effects 
of  limited  system  information  and  short  lead  times  provide  lessons  in  what  to  avoid  in 
future  acquisitions.  In  a  state-of-the-art  study  in  LCC  by  Walker  of  the  Boeing  Company 


(1974),  only  initial  contractor-provided  training  is  included  in  the  14  electronic  data 
processing  (EDP)  models  studied.  An  interesting  conclusion  of  this  study  is  that  LCC 
models  do  not  provide  realistic  cost  figures. 

One  of  the  approaches  in  LCC  is  design  to  cost,  which  was  described  by  Hackett, 
Monroe,  Galin,  Marecki,  and  Schotzman  (1975).  This  study  provides  a  clear  explanation  of 
the  acquisition  process. 

A  1977  study  by  Berard  concentrates  on  operating  and  support  costing  in  three 
ongoing  hardware  acquisitions:  F-18  (Navy),  ARC-164  (Air  Force),  and  Blackhawk  (Army). 
Apparantly,  training  was  not  a  problem  in  these  acquisitions,  since  Berard  discusses  only 
other  ILS  problems  and  the  techniques  involved  to  solve  them. 

System-Oriented  Life  Cycle  Cost  Models 

The  Air  Force  Logistics  Command  model  (1975)  utilizes  system  operational  service 
life,  mean  time  between  failures,  and  the  maintenance  concept  to  determine  the  number 
of  personnel  to  be  trained  for  base  and  depot  facilities.  The  model  does  not  include 
operator  or  support  personnel  training.  Course  length,  training  cost  per  hour,  and  cost  of 
training  equipment  must  be  provided  by  die  model  user. 

Two  cost-of-ownership  models  (Litton  Systems,  Inc.,  1976;  Boeing  Company,  undated) 
are  very  similar  to  the  Air  Force  Logistics  Command  model.  Both  require  training 
information  as  input  terms.  Operator,  support,  and  instructor  personnel  training  are  not 
included. 

The  training  section  of  the  Naval  Weapons  Engineering  Support  Activity  model  (1975) 
is  the  most  detailed  of  any  of  the  LCC  models  reviewed.  In  this  model,  which  is  indexed 
to  the  MIL-STD-881  work  breakdown  system,  training  is  divided  into  test  and  evaluation 
(T&E),  initial,  and  recurring  segments.  Operator  and  technician  training  includes  military 
and  civilian  personnel.  Facilities,  training  aids,  training  material,  and  travel  costs  are 
included  as  elements.  Some  of  the  model  limitations  are  that:  (i)  the  number  of  students 
must  be  supplied,  (2)  system  and  training-support  personnel  training  and  utilization  are  not 
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included,  and  (3)  model  terms,  such  as  standard  course  fee  and  weekly  course  fee,  are  not 
defined. 


The  Army  model  is  in  EDP  format  (Army  Electronics  Command,  1975).  Its  primary 
purpose  is  to  determine  ILS  cost  for  electronic  equipment.  A  unique  feature  of  this  model 
is  the  use  of  training-cost-for-manpower  as  one  of  the  variables  in  the  sensitivity  analysis. 
The  cost  per  military  occupation  specialty  (MOS),  training  time,  and  time  between 
training  are  all  input  terms  to  be  provided  by  an  unidentified  source. 

Two  other  models— those  developed  by  Gay  and  Nelson  (1974)  and  Rome  Air 
Development  Center  (1976)— also  require  input  terms  that  training  model  should  generate, 
such  as  training  cost  per  manweek,  training  manweeks,  and  recurring  training  factors. 
The  Gay  and  Nelson  model  includes  initial  training  by  the  contractor. 

Current  Ship  Acquisitions 

A  life  cycle  manpower  cost  methodology  was  developed  in  1968  for  the  Amphibious 
Assault  Ship  (LHA)  (Taylor,  1968).  For  that  time  period,  the  model  is  quite  comprehensive 
for  a  complex  weapon  system.  The  Taylor  (1968)  paper  contains  one  of  the  few 
discussions  of  officer  costs.  The  LCC  model  has  divided  the  enlisted  personnel  into  five 
functional  groups,  and  per  capita  cost  figures  are  utilized  to  compute  total  personnel 
costs.  The  paper  and  its  appendices  provide  detailed  equations,  cost  collection  forms, 
cost  factor/category  definitions,  and  cost  tables  available  at  that  time  (1967).  from 
various  Navy  sources.  This  study  was  conducted  between  Defense  Systems  Acquisition 
Review  Council  (DSARC)  I  and  II. 

The  Destroyer  (DD  963)  literature  does  not  include  costs,  but  is  of  interest  as  an 
example  of  a  modem  ship  acquisition  (DD  963  Integrated  Logistic  Support  Plan,  undated; 
Litton,  1974,  1975).  LCC  models  and  training  models  typically  do  not  include  the  cost  of 
preparing  this  type  of  documentation  during  the  training  requirement  and  planning  phases. 
These  documents  list  the  number  of  contractor,  Navy,  and  advisory  service  courses 
required  for  each  ship.  They  required  4  years  to  compile  and,  since  they  were  produced  by 
the  contractor,  the  recorded  costs  should  be  available  for  future  system  managers. 


Pertinent  Government  Publications 

The  government  publications  listed  in  Table  1  were  reviewed  to  discern  the 
acquisition  and  operation  of  the  training  function  in  a  weapon  system.  The  number  of 
documents  reviewed  was  limited  by  their  av  inability  through  DTIC. 

Collectively,  these  documents  were  reviewed  to  identify  the  functions  and  organiza¬ 
tions  involved  in  Navy  weapon  system  training.  In  this  structure,  the  key  document  is 
OPNAVINST  1500.8H,  which  describes  the  tasks  of  developing  Navy  training  plans  (NTP). 
Appendix  C  of  OPNAVINST  1500.8H  is  a  sample  NTP  that  identifies  responsible  agencies. 

Circular  A- 109  from  the  Office  of  Management  and  Budget  is  written  at  a  policy 
level;  therefore,  its  impact  on  Navy  training  will  not  be  evident  until  it  is  interpreted  and 
implemented  by  Navy  procedural  documents.  However,  circular  A- 109  institutes  addition¬ 
al  control  on  the  acquisition  process  by  using  the  mission  element  need  statement 
document  and  adding  a  decision  point  (Milestone  0).  This  will  emphasize  front-end 
analysis  and  will  require  early  and  accurate  input  from  training  managers.  The  test  and 
evaluation  phase  is  expected  to  become  more  stringent  with  increased  requirements  for 
trained  personnel. 

Instructional  Systems  Development 

Two  models  are  needed  to  bring  order  to  the  problems  of  instructional  costing.  The 
prominent  one  is  the  instructional  systems  development  (ISD)  model,  which  defines  the 
process  of  developing  instruction  from  determining  course  requirements  through  course 
revision.  This  kind  of  model  focuses  primarily  on  the  content  and  delivery  of  the 
instruction.  This  emphasis  is  appropriate,  since  effective  instruction  is  the  most  basic 
requirement  of  all  instructional  programs.  The  second  model,  which  may  be  more 
appropriate  to  the  process  of  costing  instruction,  is  a  model  of  the  instructional  system 
that  includes  all  of  the  elements  and  activities  required  to  conduct  instruction.  Although 
it  is  usually  assumed  that  such  a  model  falls  out  of  ISD  models,  it  rarely  does.  In  the  case 
of  ongoing  instruction  in  established  schools,  the  system  is  the  entire  school,  which  is 
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Table  1 


Some  of  the  Government  Publications  Related  to 
Navy  Training 


Title 


Date 


Subject 


OMB  Circular  A- 109 
DOD  4 100.3  5G 

DOD  7041.3 

MIL-STD-1379A 
SECNAVINST  5000.1 

SECNAVINST  7000.14B 

OPNAVINST  1500.2E 

OPNAVINST  1500.8H 

OPNAVINST  1500.19C 

OPNAVINST  1500.44 
OPNAVINST  3500.23B 

OPNAVINST  4490.2B 
OPNAVINST  4700. 12C. 

OPNAVINST  5000.42A 
OPNAVINST  5300.3A 

OPNAVINST  9860.5 

NAVMAT  P-4000 

NAVMATINST  1500.2C 

NAVMATIN5T  4000.20B 
NAVMATINST  5311.2A 
NAVMATINST  5311.3 

NAVSEAINST  1543.1 

NAVSEAINST  4105.1 
CNET1NST  1500.9 


5  Apr  76 
1  Oct  70 

18  Oct  72 

1  Oct  76 
13  Apr  72 

18  Jun  75 

3  Apr  73 

3  Jul  75 

7  Jul 72 

24  Oct  73 
5  May  72 

13  Apr  70 
20  May  70 

3  Mar  76 

25  Sep  75 

3  Jun  68 

March  72 

17  Apr  75 

27  Jun  75 
2  Nov  76 
5  Sep  74 

Unknown 

22  Jul  77 

26  Jun  74 


Major  system  acquisitions 

Development  of  integrated  logistic  support  for 
systems  and  equipments 

Economic  analysis  and  program  evaluation  for 
resource  management 

Contract  training  programs 

System  acquistion  in  the  Department  of  the 
Navy 

Economic  analysis  and  program  evaluation  for 
Navy  resource  management 

Establishment  and  coordination  of  factory 
training  programs  for  military  and  civilian 
personnel;  responsibilities  and  procedures  for 

Preparation  and  implementation  of  Navy 
training  plans  (NTPs)  in  support  of  hardware 
and  nonhardware  oriented  developments 

Authority  and  responsibility  of  Fleet  Com¬ 
manders  in  Chief  for  naval  training  activities 
ashore 

Responsibilities  for  development  of  training 
requirements  and  training  plans 

Assembly,  organization,  and  training  of  crews 
for  U.S.  Navy  ships  commissioned  in  time  of 
peace 

Availability  of  equipment  for  training  purposes 

Responsibilities  in  development  of  Navy 
shipbuilding  and  conversion  programs 

Weapon  system  selection  and  planning 

Development  and  review  of  enlisted  manpower 
requirements  in  naval  ships 

Incorporation  of  self-contained  training  capa¬ 
bilities  into  shipboard  equipment  and  systems 

IL5  implementation  guide  for  DoD  systems  and 
equipments 

Preparation  and  implementation  of  Navy 
training  plans  for  new  developments 

Integrated  logistic  support  planning  policy 

Military  personnel  and  training  requirements 

Personnel  and  training  analyses  office;  utiliza¬ 
tion  of 

Manpower,  personnel,  and  training  support  for 
NAVSEA  cognizant  ship,  system,  equipment, 
and  nonhardware  developments 

Integrated  logistic  support  (ILS);  policy,  re¬ 
sponsibilities,  and  planning 

Participation  by  the  Naval  Education  and 
Training  Command  in  the  preparation  and  im¬ 
plementation  of  Navy  training  plans 


usually  taken  as  a  given  by  the  ISD  activities  revising  old  courses  or  creating  new  ones.  In 
the  case  of  system-oriented  instruction,  any  new  instruction  required  must  be  addressed  in 
terms  of  developing  an  entire  instructional  system,  not  just  the  student-oriented  aspects. 
An  instructional  costing  model  must  address  design  and  development,  not  only  of  the 
instruction  itself,  but  also  of  administration,  support,  and  required  noninstructional 
facilities.  An  adequate  instructional  costing  model,  then,  should  somehow  encompass  the 
instructional  system  and  its  development  and  operation. 

An  extensive  literature  base  exists  in  the  general  area  of  instruction  and  ISD.  One 
bibliography  published  by  Schumacher,  Pearlstein,  and  Martin  at  the  beginning  of  1974 
contained  2692  items  pertinent  to  ISD.  The  majority  of  this  literature  addresses  the 
difficult  areas  of  content  development,  methods  of  delivery,  and  instructional  strategies. 
Some  of  it  involves  the  process  of  developing  effective  instruction  efficiently. 

To  develop  a  model  for  determining  the  life  cycle  costs  of  system-oriented  training, 
however,  almost  all  of  the  literature  cited  appears  to  be  inappropriate.  Much  of  it 
concerns  the  learning  process  itself,  civilian  education,  or  details  of  instruction  and 
alternative  instructional  delivery  techniques.  Even  if  the  subject  matter  is  identified  as 

r 

involving  systems — as  in  the  instructional  systems  or  training  systems  development 
literature — it  usually  is  used  in  the  sense  of  a  systematic  approach  to  instructional 
development. 

Training  Model 

A  training  model  addressing  the  problem  of  improving  effectiveness  in  some  areas  of 
Army  training  was  developed  in  a  series  of  four  articles  by  Weingarten  et  al.  (Weingarten, 
Hungerland,  Brennan,  Allred,  and  Pollyea,  1970;  Weingarten,  Hungerland,  Brennan,  & 
Allred,  1970,  1971;  Weingarten,  Hungerland,  &  Brennan,  1972).  This  model  addresses  the 
nature  of  a  course.  The  course  is  analyzed  into  content  modules  (i.e.,  blocks  of 
instructions).  Each  module  is  then  organized  into  a  sequence  of  instructional  activities 
that  culminate  in  peer  instruction  and  course  administration  assistance.  The  approach 
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was  used  on  a  specific  course.  Comparisons  between  this  new  course  and  the  prior  one  are 
based  on  differences  in  average  training  days  required  and  estimates  of  cost  per  man-day 
of  training. 

The  Weingarten  model  illustrates  some  of  the  problems  of  attempting  to  apply  the 
general  literature  to  the  current  program.  As  this  model  represents  the  specific 
instructional  strategy  of  using  peer  instruction,  it  is  not  generally  applicable.  The 
existence  of  a  system  to  provide  the  necessary  personnel  and  materials  to  administer, 
support,  and  conduct  the  instruction  is  assumed.  Hence,  the  model  is  oriented  to  the 
systematic  development  and  conduct  of  the  instruction,  rather  than  to  the  development  of 
an  entire  instructional  system.  Finally,  the  detail  of  the  cost  evaluation  is  only  sufficient 
to  determine  the  cost  differences  between  the  new  and  prior  courses;  it  is  not  sufficient 
to  determine  the  total  course  costs  in  either  format. 


Method  of  Designing  Instructional  Alternatives  (MODIA) 

A  much  more  detailed  approach  (Petruscheli,  1972)  was  developed  in  the  Rand 
Corporation's  Method  of  Designing  Instructional  Alternatives  (MODIA)  program  for  the 
Air  Force.  Petruscheli  (1972)  presents  a  demonstration  by  applying  this  approach  to  the 
redesign  of  an  Air  Force  course  in  basic  photography.  MODIA  is  oriented  to  detailed 
course  design  using  ISD  procedures  to  evaluate  instructional  alternatives  and  also  has  a 
highly  sophisticated  set  of  costing  procedures.  Costs  are  included  for  direct  support, 
administration,  and  indirect  support.  The  cost  analysis  is  sufficiently  detailed  for 
subsequent  computerization. 

Even  this  elaborate  approach  falls  short  in  some  areas,  however.  Two  models  really 
were  developed.  The  instructional  systems  design  model  describes  course  design  and 
development,  but  does  not  describe  the  instructional  system.  The  costing  model 
categorizes  the  operation  of  the  course  in  detail,  but  does  not  explicitly  describe  the 
instructional  system  either,  since  it  assumes  that  this  course  is  in  one  of  the  departments 
of  an  operating  school.  In  addition,  the  course  design  and  development  process  is  not  part 


of  the  costing  model.  The  instructional  design  model  also  assumes  the  existence  of  a 
school  and  the  requirements  for,  and  general  structure  of,  the  course.  The  front-end 
analysis  and  planning  activities  needed  for  the  course  development  are  not  part  of  either 
model. 

Selecting  Cost-Effective  Methods  and  Media 

Spangenberg,  Riback,  and  Moon  (1973)  reviewed  the  status  of  selecting  cost-effective 
methods  and  media  for  training  and  presented  an  excellent  analysis  of  costing  problems 
and  approaches.  The  instructional  methods  and  media-selection  procedures  available  at 
that  time  were  not  really  adequate  to  the  Army's  problem,  because  they  were  either  too 
simplified  or  too  complicated.  To  a  large  degree,  this  is  also  true  for  applying  the 
existing  literature  to  the  development  of  a  system-oriented  life  cycle  training  model. 
Even  in  areas  where  submodels  might  be  assimilated,  they  tend  to  be  either  too  detailed 
or  too  gross  to  be  directly  useable. 

The  Training  Effectiveness  and  Cost  Effectiveness  Prediction  (TECEP)  model,  which 
was  developed  by  the  Training  Analysis  and  Evaluation  Group  (TAEG)  at  the  Naval 
Training  Equipment  Center  (NTEC),  goes  a. long  way  toward  overcoming  these  difficulties 
by  attempting  to  organize  the  complicated  details  of  content  characteristics  and  media 
capabilities  into  categories,  thus  simplifying  the  media-selection  process  without  losing 
meaningful  detail  (Braby,  Henry,  Parrish,  &  Swope,  1975).  The  TECEP  model  was 
developed  to  fit  into  the  Interservice  Procedures  for  Instructional  Systems  Development 
(IPISD)  model  (see  following  section)  and,  consequently,  deals  neither  with  the  entire 
instructional  system  nor  the  entire  development  process.  As  a  component  of  a  life  cycle 
training  model,  it  has  the  drawback  of  being  a  prescriptive  or  directive  model  that  is 
designed  to  give  relatively  specific  guidance  to  the  media  selection  process. 

Interservice  Procedures  for  Instructional  Systems  Development  (IPISD) 


The  most  important  milestone  in  the  ongoing  evaluation  of  the  instructional  systems 
development  process  to  date  was  the  publication  of  the  IPISD  in  1975  (Branson,  Rayner, 


Cox,  Furman,  ic.  King,  1975a,  b,  c,  d,  e;  Branson,  Rayner,  Furman,  &  Cox,  1975).  The 
procedures  were  accepted  as  the  definitive  guides  for  the  development  of  new  training  by 
all  services.  In  the  Navy,  even  factory  training  is  to  be  developed  in  accordance  with  its 
procedures.  Basically,  this  development  process  model  attempts  to  combine  the  best  of 
earlier  instructional  development  approaches  into  five  major  phases:  analyze,  design, 
develop,  implement,  and  control.  Detailed  guidance  is  presented  for  the  activities  in  each 
phase.  Because  it  has  been  accepted  by  all  of  the  services  (particularly  the  Navy),  it 
seems  highly  desirable  to  use  this  model  as  the  basis  for  the  system-oriented  life  cycle 
training  model.  As  with  the  previously  noted  models,  however,  there  is  no  clear  or 
explicit  model  of  the  instructional  system  itself.  In  line  with  this  omission,  the  model 
tends  to  emphasize  the  development  and  delivery  of  the  instruction. 

The  model  does  give  attention  to  other  necessary  system  elements  such  as  instruc¬ 
tors,  equipment,  facilities,  and,  to  some  degree,  system  administration  and  support. 
However,  these  factors  are  treated  only  in  their  immediate  relationship  to  instructional 
delivery.  Another  positive  attribute  of  the  model  is  that,  in  the  development  areas 
covered,  ancillary  activities  of  the  developing  agency  are  identified  as  management 
decisions  and  may  be  used  as  guidance  foe  development  costing.  In  general,  the  IPISD 
model  is  an  attractive  candidate  to  be  used  for  guidance  in  the  formation  of  the  system- 
oriented  life  cycle  training  model. 

ISP  Applications 

Three  recent  applications  of  ISD  procedures  for  developing  training  for  specific 
weapon  systems  involved  the  development  of  aircrew  training  for  the  A-6E,  the  S-3A,  and 
the  E-2C  Navy  aircraft  (Bromberger,  1977;  McLachlan,  1977;  Sugarman,  Johnson, 
Mitchell,  Hinton,  tc  Fishburne,  1976). 

Although  the  S-3A  program  (McLachlan,  1977)  was  started  and  largely  carried  out 
before  the  publication  of  the  IPISD  model,  development  activities  are  consistent  with  it. 
The  procedures  used  to  develop  new  instruction  for  the  A-6E  training  were  an  amalgama¬ 
tion  of  past  ISD  approaches  and  the  relevant  procedures  from  the  IPISD  model.  These 


were  all  in  essential  agreement. 


The  E-2C  program  was  carried  out  as  an  extention  of  the  1SD  procedures  developed 
by  the  Caispan  Corporation  in  their  B-l  systems  approach  to  training  efforts  (Sugarman, 
Buckemaier,  &  Johnson,  1974),  which  were  consistent  with  the  procedures  of  the  IPISD 
model.  As  with  all  of  the  ISD  models  and  programs  cited  here,  the  major  emphasis  was  on 
the  development  of  the  instruction,  while  the  instructional  system  was  assumed  to  be 
adequate  to  conduct  and  control  the  instruction.  Again,  the  assumed  nature  and  elements 
of  such  a  system  must  be  inferred. 

Of  special  interest  in  the  E-2C  and  A-6E  reports,  however,  were  efforts  to  cost  the 
instructional  developments  involved.  The  E-2C  program  costed  four  activities- -planning, 
task  analysis,  training-objectives  development,  and  lesson  specification  and  instructional 
delivery  method- -in  terms  of  the  estimated  manpower  and  travel  costs.  In  the  A-6E 
report  (Bromberger,  1977),  manpower  was  estimated  for  five  technical  activities  (plan¬ 
ning,  task  analysis,  specific  behavioral-objectives  development,  media  analysis,  and 
lessons  specifications),  as  well  as  for  preparation  of  the  program  final  report.  Travel  and 
data-computing  services  costs  for  the  entire  program  were  also  given.  Although  these 
exercises  are  fairly  rudimentary  and  estimates,  rather  than  exact  calculations,  were  used, 
they  at  least  point  to  the  possibility  of  estimating  costs  of  developing  instructional  system 
elements. 

Additional  Elements  of  Instructional  Systems 


The  recent  literature  reinforces  the  need  to  categorize  all  the  elements  of  an 
operating  instructional  system,  as  well  as  the  structure  of  the  developmental  process. 
Orlansky  and  String  (1977a)  analyze  the  role  of  simulators  in  aircrew  training.  Full- 
mission  simulators  have  become  increasingly  expensive  as  the  prime  systems  in  this  area 
have  become  increasingly  complex.  Although  they  do  not  require  their  own  DSARC-keyed 
cycles,  they  require  design  and  support  development  that  is  as  complex  as  many  other  full 
system  developments.  If  they  are  considered  as  instructional  media— which  they  basically 
are— the  size  of  the  instructional  delivery  element  of  the  instructional  system  is 


increased  enormously.  They  also  require  major  development  and  operation  activities  in 
the  support  element  of  the  instructional  system,  including  maintenance  activities, 
significant  spares  and  provisioning  activities,  and  a  programming  or  reprogramming 
capability.  The  instructional  system  administrative  element  will  also  be  enlarged 
accordingly. 

The  problems  of  evaluating  instructional  systems  were  addressed  by  Hall,  Lam,  and 
Bellamy  (1976)  and  Hall,  Rankin,  and  Aagard  (1976).  The  thrust  of  these  reports  is  that 
the  Navy— as  well  as  the  other  services— must  increase  its  evaluation  of  instructional 
system  effectiveness  to  ensure  the  cost  effectiveness  of  instructional  systems.  Both  the 
potential  for  increasing  combat  readiness  and  ensuring  maximum  effectiveness  for  each 
training  dollar  spent  justify  formalizing  the  instructional  system  evaluation  element  and 
allocating  funds  for  providing  evaluation  feedback  from  the  operational  units  to  the 
instructional  system. 

Costing 

Procedures 

Successfully  determining  the  cost  of  any  system  depends  upon  the  analyst's  interpre¬ 
tation  of  cost  and  how  completely  the  system  is  defined.  G.  H.  Fisher  (1971)  stresses  the 
use  of  economic  cost,  where  the  use  of  resources  in  one  program  represents  a  cost  since 
these  resources  cannot  be  used  in  other  programs.  In  this  light,  most  existing  training 
models  are  incomplete,  in  that  they  do  not  include  costs  of  management,  administrators, 
planners,  and  the  like. 

Fisher  also  recommends  the  use  of  dollar  costs  as  a  measurement  tool  to  select  and 
compare  alternatives.  The  use  of  dollars,  however,  to  quantify  elements  in  a  training 
course  is  extremely  hazardous.  Cost-Effectiveness:  The  Economic  Evaluation  of 
Engineered  Systems  (edited  by  3.  M.  English,  1968)  contains  an  excellent  section  on  cost- 
effectiveness  fallacies  and  misconceptions  that  should  be  reviewed  by  anyone  determining 
or  evaluating  the  cost  of  training  courses. 
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In  1976,  Navy  training  was  analyzed  by  Doughty,  Stern  and  Thompson,  as  well  as  by 
Swope.  Both  reports  provide  specific  guidance  and  procedures  for  costing  Navy  training. 
Doughty  et  al.  (1976)  also  provide  samples  of  cost-collection  and  organizing  forms  and 
cost  analysis  of  the  Navy  Interior-Communications  Electrician  School  and  of  the  Army 
training  extension  course  system. 

Costing  Methods 

Training  Effectiveness  and  Cost  Effectiveness  Prediction  (TECEP).  At  the  time  of 
this  writing  (1978),  the  most  current  and  comprehensive  training  course  model  is  the 
TECEP  model  developed  from  1972  to  1975  by  TAEG  (Braby,  Micheli,  Morris,  &  Okraski, 
1972,  Braby,  Henry,  et  al.,  1975;  Swope,  1976).  The  TECEP  model  is  designed  to  evaluate 
a  single  program  (course)  of  instruction  and  would  have  to  be  iterated  to  encompass  a 
total  weapon  system  training  program.  The  iteration  process  is  feasible  since  the  model 
has  been  adapted  (FORTRAN  IV)  for  electronic  data  processing. 

The  usefulness  of  the  TECEP  model  is  somewhat  limited  because  it  omits  manage¬ 
ment,  administration,  and  other  support  costs,  as  well  as  such  operating  costs  as 
transportation,  communications,  and  technical  manuals.  Braby  et  al.  (1975,  p.  77)  also 
state  that  "the  model  (TECEP)  is  not  designed  to  predict  or  forecast  the  total  cost  of  a 
system  for  which  a  planner  must  budget  resources." 

A  study  conducted  by  Honeywell's  System  and  Research  Center  for  the  Naval  Air 
Development  Center  (Daniels  and  Cronin,  1975)  utilized  the  TECEP  model  to  compare 
automated  electronic  maintenance  training  (AEMT)  with  the  use  of  operational  hardware 
for  maintenance  training.  One  of  the  unique  features  of  this  study  was  the  use  of  a  joint 
NAVAIR/Honeywell  team  to  obtain  Navy  training  cost  data.  This  arrangement  was 
required  since  the  TECEP  model  does  not  provide  cost  sources. 

The  MODIA  Technique.  The  operation  of  MODIA  was  demonstrated  in  an  Air  Force 
basic  photography  course  (Petruschell,  1972).  The  study  is  of  interest  for  basically  two 
reasons:  First,  the  course  utilized  the  self-paced  format  that  is  becoming  more  prevalent 
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in  military  training  and,  second,  a  student  flow  simulation  technique  was  applied  to 
determine  the  demand  for  essential  resources.  The  costing  procedures  for  base  facilities 
and  administrative  personnel  are  especially  comprehensive,  but  the  media  maintenance 
manpower  and  curriculum  manpower  costs  are  only  assumptions. 

The  MODIA  technique  is  useful  from  a  life  cycle  cost  viewpoint  in  that  it  provides 
investment  (development)  and  annual  operating  costs  based  on  a  particular  student  flow. 
The  cost  of  determining  the  training  requirements  and  the  planning  (which  in  this  case 
would  be  the  cost  of  the  study)  are  omitted.  Also,  the  annual  operating  costs  may  not  be 
valid  for  an  extended  period  of  time,  as  technological  changes  in  both  operational 
equipment  and  instructional  methodology  occur. 


Undergraduate  Pilot  Training  (UPT).  A  model  for  undergraduate  pilot  training  (UPT) 
for  the  Air  Force  was  presented  by  Allison  (1969),  Boren  (1969),  and  Littleton,  (1969). 
Cost  projections  for  this  training  from  1975  to  1990  are  given  by  the  Mission  Analysis 
Study  Group  (1972).  The  Air  Force  UPT  model  only  covers  the  conduct  of  training  and 
ignores  its  development,  planning,  and  requirements.  Its  value  for  costing  Navy  training  is 
primarily  in  the  degree  of  detail  in  costing;-  for  example,  hundreds  of  cost  elements  are 
combined  to  form  22S  input  terms  that  are  used  to  calculate  an  1 1-page  list  of  variables. 
This  list  of  cost  elements  provides  an  excellent  checklist  for  costing  any  training  course. 

The  UPT  model  contains  two  features  that  are  particularly  noteworthy  in  the  field  of 
cost  modeling.  First,  to  reflect  total  Air  Force  training  costs,  the  costs  of  depot 
maintenance  of  training  aircraft— not  funded  by  the  Air  Training  Command— are  includ¬ 
ed.  Second,  investment  costs  are  reported  in  the  year  the  item  is  delivered.  This  may 
distort  the  cost-per-graduate  figures  for  some  years,  but  is  realistic  from  a  funds- 
expenditure  timing  point  of  view.  It  is  difficult  to  incorporate  an  amortization  scheme 
that  would  satisfy  all  model  users. 

Fleet  Readiness  Training  (FRT).  The  operation  of  the  Fleet  Readiness  Training  (FRT) 
model,  which  is  the  pilot  training  model  for  the  Navy,  is  described  by  Kyle,  Craig,  Fish, 


Ligget,  and  McCoy  (1971a,  b,  c,  d,  e,  f).  The  FRT  planning  tool,  which  has  been  in  daily 
use  by  the  Aviation  Training  Division  of  CNO  since  October  1970,  contains  the 
methodology  to  estimate  75  percent  of  the  total  system  cost  of  the  pilot  training  program 
after  the  costs  of  military  personnel  and  aircraft  acquisition  have  been  deducted. 

Army.  Weinberg  (1967)  attempted  to  overcome  the  insufficiencies  of  school  costing 
revealed  by  Kollin  (1966)  in  a  study  of  service  school  cost  and  recording  practices  by 
determining  gross  cost  figures.  Utilizing  the  training  allocations  of  the  Military  Personnel 
Army  (MPA),  Operation  and  Maintenance  Army  (OMA),  and  Military  Construction  Army 
(MCA)  budget  authorizations,  the  study  developed  per  capita  training  cost  for  individual 
military  occupational  specialties.  These  costs  were  then  added  to  provide  training  costs 
for  the  nine  DoD  occupational  areas. 

Spangenberg,  Riback,  and  Moon  (1973)  conducted  a  literature  study  to  determine  the 
state  of  knowledge  of  selecting  cost-effective  training  methods  and  media.  This  study 
emphasized  the  need  for  specific  cost-accounting  structures  pertaining  to  Army  training. 
The  paper  discusses  basic  mathematical  formulas  for  use  in  cost  analysis  and  demon¬ 
strates  a  procedure  for  comparing  old  and  new  courses  by  utilizing  expected  utility  values 
to  compute  cost-effective  indexes. 

General.  Thompson1  presented  an  interesting  method  of  comparing  instructional 
alternatives  and  described  the  problems  and  complications  that  arise  when  comparing 
instructional  alternatives.  The  cost  collection  forms  and  some  of  the  calculations  are 
found  in  Doughty,  Stern,  and  Thomson  (1976). 

Since  1972,  the  U.  S.  Civil  Service  Commission  has  utilized  a  training  cost  model 
(Mirabal,  1978).  This  model  was  probably  not  intended  for  technical  training  courses  in  its 
present  form,  since  little  mention  is  made  of  equipment  and  equipment-related  support 
costs. 


Thompson,  C.  Comparison  of  instructional  alternatives  from  an  economic  point  of 
view  (NPRDC  memo  201-M-239C3T).  San  Diego:  Navy  Personnel  Research  and 
Development  Center,  19^5. 
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The  worksheet  format  and  manual  calculation  process  provided  in  the  model, 
however,  could  be  used  to  predict  the  costs  of  small  infrequently-conducted  weapon 
system  training  courses,  where  EDP  cost  collection  is  impractical.  The  command  ILS 
training  requirement  or  some  of  the  training  conducted  in  the  early  weapon-system  life 
cycle  are  examples  of  where  this  method  might  applied. 

Two  TAEG  studies  (Copeland,  Nutter,  Dean,  Curry,  6c  Morris,  1974;  Copeland,  Nutter, 
Henry,  Swope,  6c  Curry,  1975)  were  conducted  to  investigate  alternative  methods  of 
providing  Navy  skill  training.  Although  the  reports  do  not  contain  much  on  actual  costs, 
they  do  describe  several  billet  training  requirements  in  detail.  The  economic  cost  analysis 
forms  included  in  the  studies  might  serve  as  checklists  for  training  planners. 

Cost  Elements 

Many  of  the  training-course  cost  models  require  cost  element  data  as  input;  for 
example,  personnel  costs  are  usually  included  in  a  single  term  describing  salary  and 
benefits  of  applicable  personnel.  Fortunately,  the  determination  of  some  of  these  cost 
elements  is  the  specific  subject  matter  of  several  studies. 

The  various  cost  elements  are  discussed  below: 

1.  Personnel.  Several  reports  are  concerned  with  the  determination  of  personnel 
costs  (Bellanca,  1975;  Clary,  1968;  Clary  &  Creaturo,  1971;  Connelly,  1966,  1967;  Martin, 
Koehler,  Mairs,  6c  Hogan,  1977).  The  most  useful  publication  is  the  Life  Cycle  Navy 
Enlisted  Billet  Cost  Tables— FY77  (Martin  et  al.,  1977),  which  provides  life  cycle  costs 
information  for  Navy  enlisted  personnel  by  ratings  and  pay  grades  in  1-,  5-,  10-,  15-,  and 
20-year  increments.* 

The  only  cost  data  discovered  for  officers  were  published  in  1971  (Clary  &  Creaturo). 
Work  on  a  current  officer  cost  model  is  planned  through  the  Navy  Personnel  Research  and 
Development  Center  (NAVPERSRANDCEN).* 


*Editor's  note:  For  latest  data,  see  Koehler,  E.  A.  Life  cycle  Navy  enlisted  billet 
costs — FY80  (NPRDC  SR  80-7).  San  Diego:  Navy  Personnel  Research  and  Development 
Center,  January  1980. 

*  Editor's  note:  See  Koehler,  E.  A.  Life  cycle  officer  billet  costs— FY80:  An  interim 
report  (NPRDC  SR  80-18).  San  Diego:  Navy  Personnel  Research  and  Development 
Center,  May  1980. 


This  particular  literature  search  did  not  reveal  any  studies  providing  cost  data  for 
Civil  Service  personnel  (GS  and  WB  classification).  NAVPERSRANDCEN  has  recently 
begun  an  effort  to  provide  a  civilian  billet  cost  model.** 

2.  Facilities.  While  most  training  costing  models  include  facility  cost  as  an  input 
item,  they  seldom  provide  cost  determination  information.  Goodyear  (1965,  1966),  as  well 
as  Wethy  and  Bumbak  (1971),  provide  lists  and  explain  several  factors  of  facility  costs. 
The  general  consensus  is  to  amortize  the  construction  cost  over  the  facilities'  useful  life 
and,  then,  use  replacement  cost  figures. 

3.  Simulators.  Simulators  have  been  the  subject  of  many  studies.  Historically, 
these  studies  have  focused  on  flight  training  simulators,  but  the  evolution  of  computer 
hardware,  software,  and  display  techniques  has  introduced  simulation  into  maintenance 
training  as  well  (Brock,  1978). 

The  complexity  and  high  costs  of  simulators  (both  investment  and  operating  costs) 
require  thorough  front-end  analysis  of  needs  and  economic  constraints.  The  B-l  systems 
approach  to  training  (Reif  &  Ring,  1975)  is  an  excellent  example  of  training  planning  and 
cost  expenditures  during  the  R&D  phase  of  modern  weapon  systems.  The  B-l  study  should 
also  be  of  value  to  training  managers  because  of  the  application  of  ISD  in  the  program. 

Another  flight  simulator  study  (Orlansky  <5c  String,  1977b)  contains  a  comprehensive 
training  cost  model  that  provides  both  investment  and  operating  costs.  The  model  detail 
includes  administrative  costs  for  both  training  and  base  support  personnel.  The  model 
does  not  include  construction  costs;  the  authors  state  that,  "in  relation  to  the  life  cycle 
costs  (or  life  cycle  training  costs)  of  the  system  the  simulator  supports,  construction  costs 
can  be  anticipated  as  a  minor  item." 


4.  Media.  Using  1970  figures,  Rhode,  Esseff,  Pusin,  Quirk,  and  Shulik  (1970)  provide 
an  extensive  list  of  media  costs.  The  list  contains  dollar  costs  for  various  media  from 


display  systems  to  text  books. 

5.  Equipment.  Three  studies  are  of  interest  in  the  area  of  training  equipment.  The 
study  prepared  by  Lintz,  Loy,  Hopper,  and  Potempa  (1973)  is  concerned  with  avionic 
subsystem  design  and  training  and  also  includes  a  discussion  of  training  equipment  costs. 
Thompson5  provides  fairly  recent  equipment  costs  in  the  area  of  computer-managed 
instruction,  as  well  as  civil  service  personnel  salary  costs.  Davis  (1977)  provides  1977 
costs  of  micro,  mini,  general  purpose,  and  dedicated  (TICCIT  and  PLATO)  computer 
systems. 

On-the-3ob  Training  (OJT) 

Several  studies  on  the  costs  of  on-the  job  training  (OJT)  were  reviewed:  Arzigian 
(1967),  Weiher  and  Horowitz  (1971),  Dunham  (1972),  Gay  (1974),  Gay  and  Nelson  (1974), 
and  Samers,  Dunham,  and  Nordhauser  (1974a,  b).  OJT  costs  seldom  appear  in  training  cost 
models  primarily  because  they  are  not  funded  in  training  budgets. 

Two  studies— Arzigian  (1967)  and  Weiher  and  Horowitz  (1971)— provide  costing 
procedures  and  list  OJT  costs  by  Navy  rating.  The  1971  cost  figures  are  as  current  as 
most  of  the  other  element  costs  found  in  the  literature.  It  is  interesting  that  most  of  the 
studies  address  the  efficiency  and  cost  effectiveness  of  OJT  versus  formal  school  training. 
The  studies  consistently  show  that  formal  school  training  provides  trained  personnel  in  a 
shorter  time  and  at  less  cost. 


DISCUSSION 

All  of  the  literature  reviewed  pertained  to  the  general  area  of  training  and  training 
development;  and  most  of  it,  to  the  more  specific  area  of  training  required  by  military 
systems.  However,  there  was  a  great  diversity  as  to  problems  addressed,  viewpoints 


» 


‘Thompson,  C.  Cost  comparison:  Cl  versus  CMI  (NPRDC  memo  201-M-12ICT).  San 
Diego:  Navy  Personnel  Research  and  Development  Center,  August  1975. 
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taken,  approaches  used,  and  models  developed.  This  diversity  may  result  from  the 
differing  backgrounds  and  orientations  of  the  three  groups  of  people  who  are  involved  with 
a  system-oriented  training  course  during  its  life.  The  first  group  consists  of  people  from 
the  principal  development  agency,  who  establish  training  requirements  and  develop  the 
training  plan.  Although  they  have  some  understanding  of  training  development  and 
operations,  they  are  oriented  to  prime  system  development,  deployment,  and  support. 
They  establish,  at  a  general  level,  the  kinds,  amounts,  and  timeliness  of  the  training 
required  for  a  successful  system  acquisition.  In  a  real  sense,  they  are  user-oriented.  They 
work  under  the  pressures  appropriate  to  the  early  stages  of  the  weapon  system  acquisition 
cycle  and  are  likely  to  give  primary  attention  to  the  early  training  necessary  for  system 
test  and  evaluation  and  initial  system  deployment. 

The  second  group  consists  of  training  development  specialists,  who  translate  the 
general  training  requirements  established  by  the  first  group  into  specific  course  content 
requirements,  and  develop  the  instructional  materials  and  strategies  required  to  carry  out 
the  training.  In  the  past,  these  individuals  were  frequently  instructors,  who  might  also 
conduct  the  training.  Increasingly,  with  the  expansion  of  training  technology,  specialists 

i» 

develop  instruction  and  leave  the  training  to  others.  Also,  they  are  becoming  more 
oriented  to  the  training  development  and  delivery  systems,  rather  than  to  the  overall 
operation  of  the  training  system.  Their  goal  tends  to  be  the  establishment  of  learning 
effectiveness. 

Finally,  the  third  group  consists  of  the  individuals  who  conduct  and  control  the 
actual  training.  They  are  the  administrators,  instructors,  and  support  personnel  that 
manage,  operate,  evaluate,  and  revise  the  training  system.  They  are  oriented  to  the 
effectiveness  of  the  training,  and  also  to  the  efficiency  of  the  day-to-day  training  system 
operations.  Their  concerns  are  not  limited  to  the  actual  instruction,  but  include 
scheduling,  personnel  handling,  equipment  and  facility  management,  recordkeeping. 


budgeting,  and  all  additional  facets  of  operating  an  instructional  system  in  a  military 

# 

training  environment.  Their  goal  is  to  operate  a  cost-effective  training  system. 

In  earlier  times  and  with  simple  systems,  the  same  individuals  might  have  performed 
all  three  functions  successively.  In  current  major  military  systems,  they  often  are  in  the 
three  separate  groups  named,  each  of  which  receives  funds  from  different  sources  and 
works  in  a  different  command. 

A  system-oriented  life  cycle  training  model  is  needed  to  provide  a  coherent  structure 
for  the  viewpoints,  goals,  and  activities  of  these  three  groups  and  to  provide  each  group 
with  the  costing  information  it  needs.  More  specifically,  the  model  should  encompass  all 
of  the  training  required  from  initial  system  development  support  through  initial  crew 
training  to  follow-on  replacement  training. 

CONCLUSIONS 

1.  In  system-oriented  life  cycle  training,  existing  elaborate  models  in  the  area  of 
major  system  acquisition  and  support  apparently  are  adequate  for  establishing  general 
training  requirements  and  training  development  plans. 

2.  Training  is  a  minor  cost  factor,  compared  to  other  elements  in  the  acquisition 
and  support  systems.  Training  costs  appear  to  be  minor,  partly  because  the  training 
spelled  out  in  these  models  is  the  factory  training  that  takes  place  during  system 
development  and  initial  deployment.  Any  follow-on  training  is  considered  to  be  simple 
iteration  of  the  factory  course.  Training  efforts  up  to  the  point  of  system  production  are 
in  fact  insignificant  compared  to  the  hardware-oriented  efforts. 

3.  Actual  CNET  responsibilities  tend  to  develop  rather  late  in  the  system  acquisi¬ 
tion  cycle.  Even  in  the  training  plan  development,  they  have  only  a  supporting  role. 

4.  The  training  required  by  system  support  personnel  tends  to  be  ignored. 

5.  Increasingly  sophisticated  ISD  models  have  been  developed.  Instructional  devel¬ 
opment  processes  are  defined  in  great  and  useful  detail.  The  current  evolution  of  these 
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models,  however,  is  strong  in  the  middle  phases  of  the  process,  but  weak  in  initial  training 
requirements  and  system  planning  efforts.  These  models  are  also  strong  in  the  areas  of 
content  identification,  media  development,  and  student  handling.  Conversely,  they  are 
weak  in  the  areas  of  instruction,  equipment,  and  facility  requirements,  as  well  as  in 
instructional-system  evaluation,  revision,  administration,  and  support. 

6.  Part  of  the  lack  of  emphasis  on  the  development  of  the  other  elements  may  stem 
from  the  fact  that  these  development  models  do  not  define  a  total  instructional  system. 

7.  If  ISD  is  to  become  what  the  name  implies,  instead  of  just  the  systematic 
development  of  instruction,  the  development  process  will  need  to  be  expanded  to 
encompass  the  entire  instructional  system. 

8.  Inadequate  attention  has  been  paid  to  the  costs  of  establishing  training  require¬ 
ments  and  plans  early  in  the  system  acquisition  process. 

9.  Most  efforts  have  addressed  only  the  initial  development  and  one-time  presenta¬ 
tion  of  instructional  material.  Course  repetition  costs  do  not  address  problems  of  revision 
or  redevelopment  of  instructional  materials  or  the  time  gaps  between  course  repetitions. 

10.  When  base  or  other  support  costs  are  presented,  there  is  ve»>  fenie  do#  si 

11.  At  this  time,  there  appears  to  "be  more  disparity  than  uniformity  in  costing 
approaches,  in  levels  of  details  given,  in  categorization  of  systems  used,  and  in  cost  areas 
included. 

12.  The  diversity  in  approaches  found  in  the  literature  may  be  due  to  the  differing 
needs  of  the  individuals  involved  in  the  training  process:  The  initial  planners  in  the 
principal  development  agency,  the  training  development  specialists,  and  those  who 
manage  and  conduct  the  training  operations. 
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